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INTF:ODUCTION 



In the school year 1957"19?Q the English De- 
partment of North Central College, Naperville, 
Illinois, accomplished a virtually complete revision 
of Its course offerings. Previous to this time the 
approach to the teaching of literature was through a 
study of historical periods and some individual 
authors. The revision established three basic genres, 
poetry, drama, and novel, with one course in Shake- 
speare and two survey courses in world literature, 
modeled somewhat on the G-reat Books pattern, to 
complement the genre cou3?ses. Eor English majors 
a course in creative X'Triting was available. 

In 1963 a quest ior.inaire was circulated to all 
North Central graduates in English, 1950-1963# 
seeking information and comment on the results of the 
education the school had provided. Certain of these 
comments led to the formulation of the present study. 
Had the revision of the curriculum in 1957 resulted 
in the prepars.tion of a teacher better prepared to 
teach literature? It was hypothesized that those 
students given a genre approach to literature would, 
on the whole, be better prepared as teachers than 
those trained under the historical period approach. 
Evaluation reports of the graduates, secured by the 
Education Department of the college from^the gradu- 
ates* employers, would be used to determine teacher 
effectiveness. Appraiss-ls of effectiveness of college 
training would be secured from the graduates them- 
selves. 



Following is an account of procedures followed 
in securing the necessary information and the use of 
these procedures in testing the hypothesis. The re- 
sults form a part of the ISCPET attempt to improve the 
training of secondary school teachers of English. 

Since the authors of this study were unable to find any 
reference in the literature to similar research programs 
in this area of curriculum arrangement, much of the 
study was on a "trial and error" basis and became espe- 
cially useful in indicating the directions for a larger 
study involving other schools in the ISCPET program. 

VJhen the Illinois State-VTide Curriculum Study 
Center in the Preparation of Secondary School English 
Teachers (ISCPET) was first established, supported by 



ftjnds suppllsd in accopdancG ■with, a con'fcpac'b with tho 
U, S. Office of Sdwcation, one of the questions pro- 
posed for answer by the tv:enty schools involved in the 
Center activities was the following: ’^VJhat preppation 

in literature is of particular value to prospective 
English teachers?’^ Among the research proposals sug- 
gested to answer the question was the hypothesis: 
^Courses in periods, genres, authors, and criticism 
are more useful to the secondary teacher of English 
than are survey courses*” 
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IffiTHOD 



In order to secure sufficient nurabers to be used 
in the study, graduates in English of the three years 
prior to the effective date of the cumculuni change was 
completely in effect were used, 1956-1958, 1961-1963. 

A complete record of each graduate's college per- 
formance was secured from the Registrar of the college. 
This included courses taken and grades earned; grade 
noint average for four years; rank in class at gradua- 
tion; high school rank in class and high school gra- 
duated from; percentile ranking on the American Council 
on Education Psychological Ibcamination. 



I<k*om the English Department files, records were 
secured indicating the individual's rank on the Coopera 
tive English Test or the Purdue English Test. A grade 
index for English courses only was calculated from the 
Registrar' s transcript . 

From the Education Department files, evaluation 
sheets (from school employers) were secured. These 
xopitis h.a.cl loQQTi soXicitiGd by tiiG 3duccii3ion Dopair'bniGnu 
softer the first and after the second years of teaching. 
(A'opendix A— 1) A total score and a score from the 
content area of the evaluation form x^^ere secured; and 
an average score, ranging conceivably from 1 to 5 ^^as 
computed for each graduate for each of the two years. 

All of the inforraation secured was entered on a 
record sheet developed for this study (Appendix A-2). 
The record sheet included in the appendix records the 
information for this study but was also designed for 
use in a larger subsequent study, hence it calls lor 
more information than was used in this particular 
examination of the North Central College curriculum 

revision. 



From the graduates of both periods a Self 
Appraisal of College Preparation in the Area of Litera- 
ture was secured (Appendix A-3) . Scores for preparation 
in genre and in period approaches were computed, and an 
overall score was calculated. Scores could ^ range from 
1 to 5. Results were recorded on the individual report 
forms and are tabulated in Appendix B-5* 



Results were plotted on graphs (Appendix B-1 
through Appendix B-li) which compared rank in college 
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graduating class, percentile ranl-c on the ACE test, 
overall grade index and grade index in English with 
employers* ev8.1uations of teaching effectiveness* 

A Wriance greater than approximately one standard 
deviation from the mean vras considered significant 
for purposes of this study. The graphs of the two 
groups involved in the study were then compared. 



RESULTS 



There x-zere 30 English majors who graduated from 
North Central College in the three years 1956, 1957, 

1958. Of these 30, 19 had certificates to teach English. 
In the 1961, 1962, 1963 group, there were 39 graduates, 

36 with certificates to teach English. 



A major problem and weakness of the study deve- 
loped, in that, due to a lack of consistent policy in 
previous years in the Education Department, only 
evaluation returns were found for the 19 teachers in 
the 1956-1958 group. There were 21 second-year evalua- 
tion forms available for the 36 members of the 1961-1963 

group . 



In keeping with similar findings in studies made 
elsewhere, high school rank in graduating class was^ 
generally predictive of North Central College rank in 
graduating class, although this finding was not neces- 
sarily a part of the study. Of the 1956~1956 group of 
teachers (19), 12 were in the upper 1/3 of their high 
school class and graduated from North Central in the 
upper 1/3. Three from the upper l/3 in high school 
dropped below that figure in college. Of the 1961-1963 
group (36), 30 were upper l/3 in high school and college 
ranking, while 9 were upper l/3 in high school and below 
that rank in college. 

When comparing college rank in class with teaching 
performance as rated, by employing supervisors, two were 
average in the 1956-1956 group. One was above average 
and one was below average in subject competence, ‘While i 
was above, 1 average, and 2 below average 
effectiveness. Nine of the 21 teachers in the 1961-1963 
group performed about as expected, i.e., no more than one 
standard deviation from the mean as roughly outlined on 
the scattergraph (Appendix B-1) • Six performed better t an 
expected, and 6 performed below expectation in subject com- 
petence. In overall effectiveness, 5 were above average, 

5 below average, and 11 average. 

Comparing teacher effectiveness as measured by 
employer evaluations and grade point average in English 
courses at North Central (Appendix B-2) gave the 
following results: The 1956-1958 group showed 2 above 

average in subject, 2 above average in overall, 1 average 
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in subject competence, 1 belovi aver?"^e 5 n subject and 2 
below average in overall eTfectivenejs • For* the 1961 - 
1963 groupj, 9 above average in both subject competence 
and overaii effectiveness; 9 average in subject compe- 
tence and 10 in overall effectiveness. 

Comparing teacher effectiveness as measured by 
employer evaluations with grade point average in all 
work at North Central (Appendix B- 3 ) gave the following 
results: For the 19 ? 6-1958 g^oup, 3 above average in 

subject competence and 2 in overall effectiveness, 1 
average in overall effectiveness, 1 below average in 
subject competence and 1 in overall effectiveness. For 
the 1961-1963 group the results were similar: 11 above 

average in subject corapetence and in overall effective- 
ness, 11 average in subject competence and 8 in overall 
effectiveness, 3 below average in overall effectiveness. 

Relating percentile rankings on the American Coun- 
cil on Education Psychological Examination and ratings of 
teacher effectiveness by employers (Appendix B-I4.) gave 
the following statistics: The 1956-1958 group showed ^ 3 

average in subject competence and 3 in overall effective- 
ness, 1 below average in subject competence and 1 in over 
all effectiveness. For the I96I-I963 group, k- above 
average in subject competence and 3 Ih overall effective- 
ness, 9 average in subject competence and 8 in overall 
effectiveness, 7 below average in subject competence and 
9 in overall effectiveness. 

Seven of the graduates of the 1956-1958 group 
returned appraisal forms of college effectiveness in 
their preparation; twenty-one of the I96I-I963 graduates 
returned the same forms. The earlier graduates scored 
3.I1.7 on genre, 3.78 on period, and overall. The 

later graduates recorded an average score of 3 *011. on the 
genre items, 3.27 on the period items, and 3*26 on over- 
all items. On an item analysis the earlier graduates 
scored 3.29 on poetry, il,ll|. on novel, 2,86 on essay, 3*71 
on short story, ii.,17 oh drama, 3 *ll 4 - oh biography, and 
3.II4, on non-fiction. The later group scored 3,71 on 
poetry, Ii,,2l|, on novel, 2,ll3 essay, 3»33 oa short story 
3,09 on drama, 2,11.}, on biography, 2,62 on non-fiction. 
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Discussion 

Because of the small number of evaluations by 
en^loyers of the earlier graduating class, 1956-19?8, 
it was not possible to verify or to refute the hypo- 
thesis of the study* Wliat few returns there were from 
the earlier group seemed to indicate about the same 
correlations as the larger niunber of returns from the 
later group* It would appear that a more sophisticated 
statistical study would need to be made of a larger 
population, preferably including students from other 
schools wifoi different approaches to the teaching of 
literatui^e, in order to obtain support or negation of 
the hypothesis. 

It would also appear from the results, however, 
that, quite apart from the manner in which the course 
in English is taught, the more successful student in 
college, as indicated by class rank, will be the more 
successful teacher, as will the more intelligent stu- 
dent, as indicated by percentile rank on the ACE test. 

It is interesting to note that gross grade 
point average, whether overall or in English, was not 
particularly useful as an indicator of success in 
teaching. The direction of the scattergraph (Appendix 
B-3) was negative in both cases* It could be inferred 
at this point that teaching effectiveness on the field 
requi'res a different set of abilities than does the 
acquiring of grades in the classroom and that some 
other measm?e of ability would be more useful in pre- 
dicting success for teachers. It could also be 
inferred that the grading policies of the school were 
stringent and thus tended to depress all grades so 
that the just average student at Horth Central, from 
the standpoint of gross grade point average, is really 
more capable than his grades would indicate* Some 
support for this latter position might be deduced from 
the fact that class rank and rankings on the ACE tost 
did show a positive direction on the scattergraph* 
l^hen measured against other students in the school, 
in other words, the results were more what one might 
expect than when teaching effectiveness was measured 
against the absolute standard of a grade point average. 

Changes in position of individual students from 
measure to measure were noted* Although none of the 
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individuals was absolutely stable, some were relatively 
so, always either above, below, or average, no matter 
what measure was used. Some few, however, were quite 
volatile, appearing in all three categories, depending 
upon the measure. This might support the inference, 
made previously, that teaching effectiveness is not 
closely enc"igh related to any of the measures applied 
in this study for them to be used as absolute deter- 
miners or predictors of teacher success, though, as is 
also pointed out, some measures seem more useful than 
others. 



One of the. disabilities "^of the entire study is 
its reliance upon evaluations made by supervisors. The 
variance in interpretation of scoring, and perhaps even 
in the care with which the evaluation is done, makes 
the study somewhat subjective in nature. Evaluations 
by two or three persons familiar with the teacher *s 
performance would be more reliable obviously, but it 
was impossible to secure this sort of information for 
this study. 

The results of the Self Appraisal were inter- 
esting even though inconclusive. They revealed that, 
on the whole, the earlier graduates felt they were 
better prepared to teach than were the later graduates. 
Numbers certainly might have had some effect here since 
only seven of the earlier graduates, as compared to 
twenty one of the later, were involved in the study. 
Distance from a first teaching experience could also 
have affected the results, lending enchantment to the 
college days. 

Quite important, however, was the item analysis, 
revealing that the earlier graduates felt they were well 
prepared in all genres, while the later graduates seemed 
to be able to identify more precisely a particular genre 
in which they were weak. Of special significance to the 
North Central College English Department was the fact 
that the lowest scores of the later graduates were in 
essay, biography, and non-fiction (2.I43# 2.II4, and 2.62). 
In setting up the genre approach, staffing had made it 
impossible to include a course or courses in literary 
prose (which would presumably include these weak areas), 
and the result is rather apparent statistically. Cer- 
tainly this contributed substantially to the fact 
noted above that earlier graduates rated their overall 
preparation higher than the later graduates did. 



8 



Of equal significance was the fact that in the 
two genres in which the later graduates felt better 
prepared than did the earlier graduates, i.e., novel 
and poetry, the faculty persons teaching in those areas 
have been on the staff throughout the period covered by 
the study. It is not beyond reason to assume that one 
person specializing in a genre may become esqjert enough 
to bring about noticeable and even statistically signi- 
ficant changes in the ability of students to function 
as teachers in those genres after graduation. 

Rather incidental to the purpose of the study, 
but of possible significant value to any English depart- 
ment, is that the switch from a period to a genre approach 
made it possible to readily identify weak areas in the 
course offerings of the school as indicated by the 
graduates* self appraisals of their college preparation. 
When the teaching of the various forms of literature is 
scattered in a number of different courses, any weakness 
in a particular form tends to be obscured. If a college 
has the means to correct a weakness, the genre approach 
at least makes its identification much more possible. 

It is perhaps also possible to suggest that, if 
all courses in a genre are taught by one teacher, the 
genre approach in a smaller school has an inherent 
strength (or weakness, as the case may be). In effect, 
the approach becomes a form of teacher appraisal as 
well as an appraisal of college preparation. What the 
result would be in a larger school (or in a smaller 
institution, for that matter) where several teachers 
handle each genre would be harder to identify, but 
particular areas of strength and weakness could still 
be singled out. 
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CONCLUSIONS, IMPLICATIONS, RECOMMENDATIONS 



No definite answer to the hypothesis of the study 
was discovered duo to limitations in the data available 
which appeared as the study progressed. It became 
apparent that a more selective and definitive evalua- 
tion form was needed to verify or disprove the hypothesis 
and that evaluation reports from several observers would 
be more useful and reliable. It could be said that the 
change in curriculum at least had no measurably bad 
effects on teaching effectiveness. 

Somewhat incidental to the purpose of the study, 
it appeared that rank in class and percentile rank on 
the ACE test x^ere fairly reliable indicators of future 
teacher effectiveness. Gross grade point averages were 
not. 



The difficulty of obtaining an objective answer 
to the hypothesis of this study is made more apparent 
by the «tudy. However, that answer would still seem 
to be a valid and especially pertinent goal to seek if 
possible. If larger numbers of teachers were used, more 
schools involved, more accurate instruments devised, and 
a wider range of measures applied, it would seem that 
results might be obtained which would allow for general! 
zation and might support or negate the hypothesis. If 
different approaches to the teaching of English at the 
college level could be compared, perhaps using results 
from several different schools, some directions might be 
indicated. In fact, as a result of this study, a more 
aD^ibitious program, involving five schools, was proposed 
and set up incorporating the experience of this study 
and attempting to solve some of the problems that it 
revealed. 

Certainly the cry from the high schools for 
teachers better prepared to teach indicates the impor- 
tance of any and every possible effort to ascertain 
those methods of approach to teacher training at the 
undergraduate level which will be most effective. 

This particular study has benefited North Central 
Collegers English Department in helping to reveal pro- 
blem areas in its teacher training program. The 
compilation of the statistics served the department 
in discovering facts about its program and the 
assumptions underlying that program. The most 
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challenging fact discovered concerned the assumption 
that the course offerings that had been included were 
adequately covering all of the genre areas needed in 
teaching English in the high school* The study 
revealed that this assumption was not well grounded 
and suggested definite directions for change in the 
program. Any department, in any college, faced with 
the problem of verification of the assumptions of 
its educational philosophy could benefit from the 
sort of study made possible by this ISCPET grant. 



SUimRY 



This study was an attempt to determine whether 
a curriculum change effected in the English Department 
of north Central College in 1957-1958 has resulted in 
improved teacher effectiveness of graduates as measured 
by evaluations provided by the supervisors or by the 
principals of the graduates in the field. It was hypo- 
thesized that the change to a genre approach to litera- 
ture would give a prospective teacher better preparation 
than the period approach which had been used previously 
at the college. Statistics were compiled on two 
of students — 19 ^^’^ho graduated in 1958-1958 and 3o who 
graduated in 196I-I963. It was discovered that, due to 
the small numbe?i? of evaluations of the earlier graduates, 
no real proving or disproving of the hypothesis could be 

made • 



Some correlations between teacher effectiveness 
and the ob jective ds-ta were noted for tne later gradua— 
tins?* group*. These findings were of interest and possible 
significance to the English Department of the college in 
future training of teachers. 

Some possibilities of the genre approach in 
identifying strengths and weaknesses in course presen- 
tations were indicated. 

Shortcomings of the study served to point up the 
need for a larger program with more carefully controlled 
statistical sources and more refined evaluative instru- 
ments. It would appear that the genre approach at I®^st 
has done no worse in preparing effective teachers, hut, 
if possible, the hypothesis still needs to be ^supported 
or negated for future guidance in teacher training 
programs in English. 
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Appendix A-1 



^ICRTK CEm 
r.:uFERViu.:2, 



,L COLLETS 
ILLINOIS 



TEAGIIER EVALUATION SGALS 



Name of Teacher 

Name of Principal oi* Superintendeno 
School Address 



Persor^al (jual.lt1.e s : 

1, IniellisoriGo (:ludi;rr'.«nt^ iorof-rlght) 



n 

4 I • 



fieliabili ty ( promptness , d ependabil i ty, 
conscxGntiousness, sense cf responsibility) 



3« Emotional stability (professional poise, 
ever, temper ) 

4 . Initiative (criminality, creativeness, 
resourcefulness ) 

Attractiveness (appearance, di’ess, manner) 
6. Oonsiderateness (courtesy, tact, sympathy) 



7 . Sntl\Tisiasm (inteiest). 
3. Adaptability 

I 

9. Sense of humor 



10. Voice (raodulabicn, expressiveness, 
use cf English) 

11. Health (vitality, energy, drive) 



Hlg 

1 2 3 li ^ 
12 3 1;^ 

12 3 1^ 

12 3^5 

1 2 3 U 5 
1 2 3 U 5 
12 3 15 
1 2 3 5 

12 3 15 
12 3 15 

12 3 15 



Profess iona 1 Hncwledge, Skills, Attitude : 



1, 



Kn cvdec3ge of 
accuracy of 
interest in 



subject 

knoivledge 

subject) 



matter (breadth and 
, scholarship, 



1 2 3 u 5 
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^5* 



Appendix A-1 (continued) 
Teacher Svaluation Scale - 2 



2* Proiessioncl attitudes (interest in teaching^ 
open-mindedness > cooperation, receptivity to 
criticism) 

3. Knowledge of principles and techniques of teaching 

I].* Understanding of pupil growth and development 
Sldll in deciding on appropriate objectives 

6. Skill in using a variety of instructional 
materials (resources, equipment, textbooks, 
other materials) 

7. Skill in selecting and planning s variety of 
appropriate learning activities 

8. Skill in directing learning activities 

9. Skill in teacher-pupil relationships (including 
discipline, working with individual pupils) 

10. Skill in classrco?n managemsnb (keeping of 
records accurately and neatly) 

11, Skill in evaluating pupil achievement 



1 2 3 U ^ 

1 2 3 

1 2 3 U ^ 
1 2 3 U ^ 

1 2 3 U 5 

1 2 3 

12 3 15 
1 2 3 U 5 

1 2 3 U 5 

1 2 3 it 5 



Descriptive statement cf teacher (including estir-ate of probable 
success as a teacher) : 



Signature 



Position 



111 . 



Appendlsc A-2 
STUDY RECORD SHEET 

Name : Scho ol t 

Address: Employer: 

High School (from): 



High School Rank 




IQ or 5 




ACT 




SAT 








BTS 1 




BTS #2 




mi 




Tilatson Glaser 




GRE 




GEE L and L 








College Glass Rank 




Overall Grade Index 




Hrs. of English (inal. I.fethods) 




English Grade Index 











Appendix A-2 (continued) 
Study Record Sheet - 2 



1st Year Supervisor 




2nd Year Supervisor 




1st Year Self Appraisal 




2nd Year Self Appraisal 








Grad. School Grade 









Appendix A-3 
TEACHER’S SELF APPRAISAL OF 
COLLEGE PREPARATION IN AREA OF LITERiiTURE 



Name: 



Teaching at: 



Belov; is presented a variety of statements pertaining to the 
preoaration your college gave you to teach literature, fete mo 
of the statements from 0 (very poor) to $ (excellent; with 3 being 
considei7cd avsrage. 



1, Ability to teach poetry. 

2, Ability to relate literature to historical periods in which 
it was written. 

3, Ability to sliow relationships betv/een literature and life. 



Ability to deal ?/ith philosophical premises underlying the 
literature. 



p* 

6 . 

7 . 

8 . 
9 . 

10 . 

11 . 

12 . 

13. 



Ability to teach the novel. 

Ability to deal with psychological premises underlying the 
literature . 

Ability to communicate own concern for literature to students. 

Ability to teach the essay. 

Ability to assign and handle book reports. 

Ability to locate and utilize literary materials other than 
textbooks. 

Ability to evaluate critically the literature textbooks 
provided. 

Ability to teach the short story. 

Ability to suggest or advise on new tenets or materials in 
literature. 

Ability to adapt literature materials to the pace and 
■ abilities of the students . 
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Appendix A-3 (continued) 

Teacher* s Self Appraisal - 2 

Ability to adapt literature assignments to students. 
Ability to teach drama. 

Ability tc cf^nverse and share v/ibh other teachers oi 
literature 9 

Ability to utilise techniques other than lecture for 
instruction 9 

Ability tc organise literature rnater5.als coherently for 
presentation to class over a period of weeks. 

Ability to teach biography. 

Ability to arouse interest in literature generally. 

Ability to relate literature to other subjects taught in 
the school. 

Ability to teach non-ficticn. 

Ability to arouse new ideas in students. 

Ability to arouse interest in literature other than 
American. 

Ability to arouse creative talents in students. 
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Appendix B-1 

GLASS RAIJIJ REUTED TO 
EAGHING SFFECTIV'EIfESS OF KORTH G£.\TIUL COLLEGE ELLILISH HlfiJORS 
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(Scores outside the double lines are approximately one standard 
deviation above or below the mean. Each n»araber refers to an 
individual of the later graduating group included in the study; 
each letter refers to an individual of the earlier graduating 
group. Each individual, in both groups, v;ill thus appear at 
two locations on graphs B-1 through 3~It.) 
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Appendix B-2 



GRADE POIOT IN EIJGLISH RELATED TO 
TE/iGKING EFFECTIVENESS OF NORTH GEI-JTRAL COLLEGE STiLISH I^IAJORS 
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Appendix B-3 



OVERALL GRADE POILT AVmGE RELATED TO 
TE'iCHim SFFEGTIVELESwS OF NORTH GErJHAL COLLATE Sl^XrLISH MJQRS 
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Appendix B-Ij. 

PEROSljriLB RANK ON THE (191^6) ACS TEST RELATED TO 
TEACHING EFFECTIVENESS OF NORTH CSOTAL GCLLSGS ENGLISH MAJORS 
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Appendix 3-p 
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